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DETAILED ACTION 

1 . This communication is responsive to the Amendment filed 06/29/2009. 

2. Claims 1-21 are pending in this application. Claims 1, 8, 12, 19, 20 and 21 are 
independent claims. In the instant Amendment, claims 1, 8, 12, 19, 20 and 21 were 
amended. This action made Final. 



Claim Rejections - 35 USC § 103 

3. Claims 1, 3-4 10-12, 14-15 and 21, are rejected under 35 U.S.C. 103 (a) as being 
unpatentable over Fuller et al. ("Fuller" US Patent No.: 6,833,865) in view of Harper et 
al. ("Harper ", US Patent No.: 6,476,817). 

As to claim 1, Fuller discloses an information processing apparatus for handling a 
storage medium storing content data and metadata associated therewith (such as a digital 
still camera or digital video recorder, has an embedded real-time content-based analysis 
function in the capture device to extract metadata from the digital signals. In one 
embodiment, metadata (descriptive information about the digital content) is formatted 
and stored separately from the content. In another embodiment, the metadata may be 
formatted and combined with the digital content in a container format such as MPEG-7, 
QuickTime, or FlashPix, abstract), comprising: 

an extracting section for extracting, from said metadata stored on said storage 
medium (such as, to extract metadata from the digital signals, abstract, col, 2 lines, 52-67 
and claim 32), and for generating a metadata extraction window (col, 3 lines, 45-67), 
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wherein the extraction section performs automatic extraction in accordance with a 
plurality of preset extraction conditions (such as, information extracted automatically by 
analyzing the audiovisual signal and extracting properties from it, such as key frames, 
speech-to-text, speaker ID, visual properties, face identification/ recognition, optical 
character recognition, col.,1 lines, 55-64, col., 2 lines, 52-67 and col, 4 lines, 1-20 and 
Figure 4 (element 401)) and manual extraction in accordance with a user's operation of 
selecting the metadata to be extracted from a list of selectable metadata (such as, if the 
user has chosen to label a video clip, as determined at a decision state 826, the camera 
interface provides a way for selecting the clip to be labeled, and entering text or selecting 
from a set of pre-defined labels, col., lines, 28-33) wherein the plurality of preset 
extraction conditions allow the extraction section performing the automatic extraction in 
response to loading the storage medium (such as, these engines perform sophisticated 
analysis of multimedia content and generate metadata descriptions that can be effectively 
used to index the content for downstream applications such as search and browse. 
Metadata generated may include: Image Feature Vectors Key frame storyboards Various 
text attributes (closed-captioned (CC) text, teletext, time/date, media properties such as 
frame-rates, bit-rates, annotations, and so forth) Speech-to-text & keyword spotting 
Speaker identification (ID) Audio classifications & feature vectors Face 
identification/recognition Optical Character Recognition (OCR) Other customized 
metadata via extensibility mechanisms: GPS data; camera position & properties; any 
external collateral data; and so forth, col., 1 lines, 51-67, col, 3 lines, 1-10 and col, 9 
lines, 10-45). 
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wherein the information display unit displays user-selectable metadata in the 
metadata extraction window (such as, information extracted automatically by analyzing 
the audiovisual signal and extracting properties from it, such as key frames, speech-to- 
text, speaker ID, visual properties, face identification/ recognition, optical character 
recognition, col.,1 lines, 55-64, col., 4 lines, 30-45 and claim 20). 

However Fuller does not explicitly disclose (a) said storage medium being 
provided with on a surface thereof an information display area (b) display data to be 
displayed in said information display area (c) an information display unit for displaying 
the extracted display data and the metadata extraction window onto said information 
display area. 

Harper, from the same field of endeavor discloses (a) said storage medium being 
provided with on a surface thereof an information display area (col., 2 line 62-64 and 
Figure 4) (b) display data to be displayed in said information display area (col, 2 line 62- 
64 and Figure 4) (c) an information display unit for displaying the extracted display data 
and the metadata extraction window onto said information display area (col, 2 line 62-64 
and Figure 4). 

It would have been obvious to one of ordinary skill in the art to modify Fuller's 
teaching with the teaching of Harper, because Harper's device eliminates the need of the 
display driver within the storage medium. 



As to claim 3 , Harper discloses wherein said information display area is 
exchangeable with another information display area. Yamaguchi from the same field of 
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endeavor disclose wherein said information display area is exchangeable with another 
information display area (Figures 1 and 4). 

As to claim 4, Harper discloses wherein said information display area is 
constituted by a rewrite sheet (col., 4 line, 50). 

As to claim 7 , Harper discloses wherein said content data include at least video 
content data and said information display unit displays, in said information display area, 
thumbnail image data extracted from said video content data on the basis of said metadata 
(col, 5 lines, 30-55). 

Claims 8 and 12 are similar in scope to claim 1 respectively, and are therefore 
rejected under similar rationale. 

Claims 10 and 14 are similar in scope to claim 3 respectively, and are therefore 
rejected under similar rationale. 

Claims 1 1 and 15 are similar in scope to claim 4 respectively, and are therefore 
rejected under similar rationale. 

Claim 18 is similar in scope to claim 7, and is therefore rejected under similar 
rationale. 

Claim 21 is similar in scope to claim 1, and is therefore rejected under similar 
rationale. 
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4. Claims 2, 5-6, 9, 13, 16 and 17 are rejected under 35 U.S.C. 103(a) as being 
unpatentable over Fuller et al. ("Fuller" US Patent No.: 6,833,865) in view of Harper et 
al. ("Harper ", US Patent No.: 6,476,817) in further in view of Bloch et al. ("Bloch" Us 
Patent No.: 5,754,102). 

As to claim 2 , Fuller and Harper do not disclose wherein said information display 
area is rewritable. 

However Bloch from the same field of endeavor discloses wherein said 
information display area is rewritable (such as, "electric paper" system is that such a 
display can be re-written upon essentially limitlessly, col., 4 line, 50). 

It would have been obvious to one of ordinary skill in the art to modify Fuller and 
Harper's teaching with the teaching of Bloch. 

The motivation to combine will provide for adding/deleting data to/from the 
storage media as desired. 

As to claim 5 , Bloch discloses, wherein said information display unit displays, in 
said information display area, said display data by coding at least a part thereof (col., 2 
lines, 5-7). 

As to claim 6 , Bloch discloses a metadata editing section for editing said metadata 
in accordance with a processing result of said content data, wherein said extracting 
section extracts said display data also from the edited metadata (col, 3 lines, 23 -36). 
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Claims 9 and 13 are similar in scope to claim 2 respectively, and are therefore 
rejected under similar rationale. 

Claim 16 is similar in scope to claim 5, and is therefore rejected under similar 
rationale. 

Claim 17 is similar in scope to claim 6, and is therefore rejected under similar 
rationale. 

5. Claims 19 and 20 are rejected under 35 U.S.C. 103(a) as being unpatentable over 
Fuller et al. ("Fuller" US Patent No.: 6,833,865) in view of Harper et al. ("Harper ", US 
Patent No.: 6,476,817) in further in view of Bloch et al. ("Bloch"Us Patent No.: 
5,754,102) and Tehranchi et al. ("Tehranchi" US Patent No.: 6,873,435). 

Claim 19 is similar in scope to claim 1, and is therefore rejected under similar 
rationale. 

However Fuller in view of Harper do not disclose information display unit 
displaying said display data as a barcode form by coding a part and a thumbnail image 
automatically. 

Tehranchi from similar field of endeavor discloses information display unit 
displaying said display data as a barcode form by coding a part and a thumbnail image 
automatically, (such as, Bar codes have also been used for tracking and identifying 
images. In diagnostic imaging, for example, patient identification information can be 
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optically encoded directly onto a film such as for X-rays, ultrasound, col, 3 lines, 35-40, 
Figure 1 and 2). 

It would have been obvious to one of ordinary skill in the art to modify Fuller's 
teaching with the teaching of Tehranchi. 

The motivation to combine to provide, from an image processing apparatus, an 
output print generated from digital data, where encoded metadata identifying a data 
source and image processing variables is coupled to the output print, and to provide a 
method for image processing using such encoded metadata. 

Claim 20 is similar in scope to claim 19, and is therefore rejected under similar 
rationale. 

Response to Arguments 

6. Applicant's arguments with respect to the amended claims 1, 8, 12, 19, 20 and 21 
have been fully considered but they are not persuasive. 

Applicant argues that: (a) nothing has been found in Fuller that would teach or 
suggest the plurality of preset extraction conditions allow the extraction section 
performing the automatic extraction in response to loading the storage medium, 

The Examiner disagrees for the following reasons. 

Per (a) Fuller invention is based on technologies relating to the automatic 
extraction of metadata descriptions of digital multimedia content such as still images and 
video. Fuller also incorporates audio analysis engines that are available from third parties 
within an extensible metadata "engine" framework. These engines perform sophisticated 
analysis of multimedia content and generate metadata descriptions that can be effectively 
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used to index the content for downstream applications such as search and browse. Fuller 
teach the plurality of preset extraction conditions allow the extraction section performing 
the automatic extraction in response to loading the storage medium (such as, FIG. 5 is a 
block diagram that shows a specific example of a digital video camera 100 using the 
embedded content-based analysis engine 301 for metadata capture. The block diagram of 
FIG. 5 is similar to FIG. 4, except that the audio/video content and the metadata are 
managed and stored separately. Formatting units 504 and 505 handle the metadata and 
video content formatting operations separately. The video storage 704 could use any of 
the currently existing digital tape formats (e.g., Dl, D3, D5, DV, Digital Betacam, etc.), 
while the metadata storage 703 may be a proprietary format stored separately on a hard 
disk or internal memory. In this situation, the metadata can be downloaded by a standard 
RS-232 serial interface, USB bus, or other standard computer interface. Some digital tape 
formats have a feature known as "MIC", or Memory in Cassette, that allows metadata to 
be stored on a non-volatile RAM chip contained in the digital tape housing. This allows 
the metadata to "travel" with the video content, even though the two data streams are not 
combined into a unified format. See also col., 1 lines, 51-67, col., 3 lines, 1-10 and col, 
9 lines, 10-45). 

Conclusion 

7. THIS ACTION IS MADE FINAL. Applicant is reminded of the extension of 
time policy as set forth in 37 CFR 1.136(a). 

A shortened statutory period for reply to this final action is set to expire THREE 
MONTHS from the mailing date of this action. In the event a first reply is filed within 
TWO MONTHS of the mailing date of this final action and the advisory action is not 
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mailed until after the end of the THREE-MONTH shortened statutory period, then the 
shortened statutory period will expire on the date the advisory action is mailed, and any 
extension fee pursuant to 37 CFR 1.136(a) will be calculated from the mailing date of the 
advisory action. In no event, however, will the statutory period for reply expire later than 
SIX MONTHS from the mailing date of this final action. 

Inquires 

8. Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to MESEKER TAKELE whose telephone number is 
(571)270-1653. The examiner can normally be reached on Monday - Friday 7:30AM- 
5:00PM est. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, William Bashore can be reached on (571) 272-4088. The fax phone number 
for the organization where this application or proceeding is assigned is 571-273-8300. 
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Information regarding the status of an application may be obtained from the 
Patent Application Information Retrieval (PAIR) system. Status information for 
published applications may be obtained from either Private PAIR or Public PAIR. Status 
information for unpublished applications is available through Private PAIR only. For 
more information about the PAIR system, see http://pair-direct.uspto.gov. Should you 
have questions on access to the Private PAIR system, contact the Electronic Business 
Center (EBC) at 866-217-9197 (toll-free). If you would like assistance from a USPTO 
Customer Service Representative or access to the automated information system, call 
800-786-9199 (IN USA OR CANADA) or 571-272-1000. 

/Meseker Takele/ 
Examiner, Art Unit 2175 



/William L. Bashore/ 

Supervisory Patent Examiner, Art Unit 2175 



